Natural cross-modal mappings between visual and auditory features.
نویسندگان
چکیده
The brain may combine information from different sense modalities to enhance the speed and accuracy of detection of objects and events, and the choice of appropriate responses. There is mounting evidence that perceptual experiences that appear to be modality-specific are also influenced by activity from other sensory modalities, even in the absence of awareness of this interaction. In a series of speeded classification tasks, we found spontaneous mappings between the auditory feature of pitch and the visual features of vertical location, size, and spatial frequency but not contrast. By dissociating the task variables from the features that were cross-modally related, we find that the interactions happen in an automatic fashion and are possibly located at the perceptual level.
منابع مشابه
Musicians are more consistent: Gestural cross-modal mappings of pitch, loudness and tempo in real-time
Cross-modal mappings of auditory stimuli reveal valuable insights into how humans make sense of sound and music. Whereas researchers have investigated cross-modal mappings of sound features varied in isolation within paradigms such as speeded classification and forced-choice matching tasks, investigations of representations of concurrently varied sound features (e.g., pitch, loudness and tempo)...
متن کاملChimpanzees process structural isomorphisms across sensory modalities
Evolution has shaped animal brains to detect sensory regularities in environmental stimuli. In addition, many species map one-dimensional quantities across sensory modalities, such as conspecific faces to voices, or high-pitched sounds to bright light. If basic patterns like repetitions and identities are frequently perceived in different sensory modalities, it could be advantageous to detect c...
متن کاملThe co-occurrence of multisensory facilitation and cross-modal conflict in the human brain.
Perceptual objects often comprise a visual and auditory signature that arrives simultaneously through distinct sensory channels, and cross-modal features are linked by virtue of being attributed to a specific object. Continued exposure to cross-modal events sets up expectations about what a given object most likely "sounds" like, and vice versa, thereby facilitating object detection and recogni...
متن کاملSynesthesia strengthens sound-symbolic cross-modal correspondences.
Synesthesia is a phenomenon in which an experience in one domain is accompanied by an involuntary secondary experience in another, unrelated domain; in classical synesthesia, these associations are arbitrary and idiosyncratic. Cross-modal correspondences refer to universal associations between seemingly unrelated sensory features, e.g., auditory pitch and visual size. Some argue that these phen...
متن کاملThe Co - occurrence of Multisensory Facilitation and Cross - modal Conflict in the 1 Human Brain
28 Perceptual objects often comprise a visual and auditory signature which arrives 29 simultaneously through distinct sensory channels, and cross-modal features are linked by 30 virtue of being attributed to a specific object. Continued exposure to cross-modal events 31 sets up expectations about what a given object most likely "sounds" like, and vice versa, 32 thereby facilitating object detec...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Journal of vision
دوره 10 1 شماره
صفحات -
تاریخ انتشار 2010